Eye-Gaze Driven Surgical Workflow Segmentation

نویسندگان

  • Adam James
  • D. Vieira
  • Benny P. L. Lo
  • Ara Darzi
  • Guang-Zhong Yang
چکیده

In today's climate of clinical governance there is growing pressure on surgeons to demonstrate their competence, improve standards and reduce surgical errors. This paper presents a study on developing a novel eye-gaze driven technique for surgical assessment and workflow recovery. The proposed technique investigates the use of a Parallel Layer Perceptor (PLP) to automate the recognition of a key surgical step in a porcine laparoscopic cholecystectomy model. The classifier is eye-gaze contingent but combined with image based visual feature detection for improved system performance. Experimental results show that by fusing image instrument likelihood measures, an overall classification accuracy of 75% is achieved.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

What do surgeons see: capturing and synchronizing eye gaze for surgery applications.

Recording eye motions in surgical environments is challenging. This study describes the authors' experiences with performing eye-tracking for improving surgery training, both in the laboratory and in the operating room (OR). Three different eye-trackers were used, each with different capabilities and requirements. For monitoring eye gaze shifts over the room scene in a simulated OR, a head-moun...

متن کامل

Data Driven Eye Gaze Path Segmentation

The first stage of analyzing eye-tracking data is commonly to code the data into sequences of fixations and saccades. This is usually automated using simple, predetermined rules for classifying ranges of the time series into events, such as “if the dispersion of gaze samples is lower than the threshold, then code as a fixation.” More recent approaches incorporate additional eye-movement categor...

متن کامل

Can You See It? Two Novel Eye-Tracking-Based Measures for Assigning Tags to Image Regions

Eye tracking information can be used to assign given tags to image regions in order to describe the depicted scene more detailed. We introduce and compare two novel eye-tracking-based measures for conducting such assignments: The segmentation measure uses automatically computed image segments and selects the one segment the users fixate longest. The heat map measure is based on traditional gaze...

متن کامل

Differential Gaze Patterns on Eyes and Mouth During Audiovisual Speech Segmentation

Speech is inextricably multisensory: both auditory and visual components provide critical information for all aspects of speech processing, including speech segmentation, the visual components of which have been the target of a growing number of studies. In particular, a recent study (Mitchel and Weiss, 2014) established that adults can utilize facial cues (i.e., visual prosody) to identify wor...

متن کامل

Multimodal Segmentation on a Large Interactive Tabletop:

Eye tracking is a promising input modality for interactive tabletops. However, issues such as eyelid occlusion and the viewing angle at distant positions present significant challenges for remote gaze tracking in this setting. We present the results of two studies that explore the way gaze interaction can be enabled. Our first study contributes the results from an empirical investigation of gaz...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

دوره 10 Pt 2  شماره 

صفحات  -

تاریخ انتشار 2007